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Abstract 
Ao slot 30 sec! of the cient midst he axle: proces whic cb 
‘exrnalscamberome and error pre for large cae scenes the slo reais of 
mali local dels con acme seat noun of err. wile avo prema a very 
faecal esracon of the andersng geometry. On the contrary, neither any sich accarate 
rec rimtrction ofthe inital lel 3D mele nar wry trevor rho 
‘cn tha eel by ene nde th tem procs safer ei, ht 
paper presen a application of LP based SIRF opinion teciques and ls we have 
‘med our ateton ta diferente search ope: the propo of navel image bed modeling 
fn reerng methods whick are capable of atta reprdhcing fil (be 
lotrel) gal np of complex 20 viral evirnment wiles allen the ira 
‘lanton of teeta ot eatin rome ee 
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Introduction 
ascot yer there hasbeen get del af ew developer plying opal ol to 
sage analy In patel, computing Lopelgial tara has ben of area nponance 
dentin testa of a abitary 2-dsmensonal (2D) ar Sinema (3D) obs. The 
‘aot perl leva of thse object the Gael gop Unhrtely,fdamea 
skerasning wheter wo pe groups are bmorpc na decal cag Ha ee 
lesen ean solve the profi). For findaesal group of 3D obj, tis pobln is 
‘ecsle tt wo praia algo fas been found yet Aa ea, homology groups have 
smcsita te mos ateton beat hee compton are mote fase and hey sil prove 
‘reed tis paper Given 43D object 3 dinensinal Hacean apace 3, determine 
among soup ofthe bj inthe a fective way by only alin the igiization othe 
sje The eoperies of homolog soups ve aplication is any ares of barat set 
sage procening. We purcully bok ast of poi im 3D digital space, and on pps is 
{ond bomlogy soups of th dats 








(ee ea probe computer graphics th a tract a et tet abet years 
‘sthe creat of mong an eeering system capable lo prove pobre lec 














waltham, seal wold evirses,T wo ate the maa approche tht have en 
propose so fr fr that purpose. On ome hand, tae exis thse Leics that ae goon) 
vd chu eft yt ena a accrt bal 3D model of te cee, Thea hey se 
the etraded 3D mode a order to rie the sene aera) given Viewpoint. One of thee 
vantages i tat they provide great lexbity and low many of the scene’ ropes be 
‘ied daring earn E89 tangs global SD model one ca weal ler ot aly the 
tiewpoit, bt asthe Upiing coding of the scene. However, the bg dts omen 
coniumeng or very difiea aa 39 inp) fm many eases, For example sich a 3D 

aly plane obec (ex 
‘schiccual ype scenes}, bu eco exremely fat lor outue sens conning bjs 
‘wah tregulr geomet ees Te atoate enact of 3D-nodel foe nage, abo 
‘wn ah muipe ew geomet. hs bok (ad tl) a8 active reser opie computer 





‘nel cominucion tsk can be eas} for sents conan 





oot at a sinc amount of popes as en aiee i this aes oer he ist ear 


Overview of the modeling pipeline 
‘A diagram of our ystems mele pie i: wa ia Figure 1. We wil st consi the 
Sper cise af having only ne seteosopic View per Key potion of the path. Porm 
plug these stereoscopic ew, calito ofthe erescopc camera nels ake place 
tate he ef onli cera) a well x hehe practise ternal comers 
‘bythe us pin. tn this ae trier pararsers are contin in he called rine 
‘hes Ky Kye ABY such ari ss hello forse 


fed 


Here FoF) eprsents he fora kngth edocs the skewness of the 2 nage es wile 





represents te inci poi We ao mel to rad and angen) ens dria 
saute owing pel ature or this parse: 








Fs esareoe reese tera 











‘Mere (x. 9) ate the ideal (stortion tee) piel coordinates, (5) ae the comesponing observed 





sage coordinates a For etinating all thse parameters we apply 2 med 
ilar tata [3], ug ab apt senescopieiage ps of 2 calito plore 
‘opted at ros petions and eto by our eanera (ae yore 2). Aer the caer 
‘Skea his inne the lowing stages othe dling pple need take pce 


1. Local 3D mol construction: A phon nd gente repeseaaion ofthe seme 
er eich key postion ofthe path br constnced. The gmeic pat af a al eel 
‘eos 1 heel a appoints ofthe asso Boone. 

2 Approximate ressvatin beween sueesive cal 3D apd: An esintion of the 
‘elite pone between scene el medels tex pac ee. We shuld woe ony 
2 cna etna tela pose is ceded, sine ths ill tbe ued lo a eae 
‘eeiitio of the es mel, tat rely fo the ping proctdre ateake place 

3. 3D morph ale mel: constrain: The phtometi s well the peomsre mops 
tecween stscestive fal 3D snedeh i etinoted drag tht stge of the modeling 
eine 





nthe case that hn re mui views pr hey positon af the path he, seal explained 
tee will a tye toe an abt stage espns forthe 3D-mossscomintion, This 
‘ap te take pice pir the epration ep atl deseo ily, we dsr the 


Local 4D models construction 
‘er each teetacopi age pi, 23D del deci the scene neal i oxen the 
cers ewpoint us be produce dara ths stage To ths nd, sereo sche poeedare 





‘sapien sg images dented an), tat dapat ca be eaimsted 


{orl poise selected image region “of “Stag then the ean dary mip 


(Gs ell the craton mateo of th cameras) a SD rrwastraction take ple tte 
snags Norio ay pace se Figure 3). These maps respectively contin hex, yan 2 
oises ofthe reconstructed ots Wal respect to Uh 3D coarse system of the lt 


a Fe MotinZr lat) consi of the images o%-2 ke geome 


op the nage sxion doo (ald danain of game mapa acl the image “M6 (the 


leoee np) mes up what we cll 2 “load det” 4 . Harta ten ill 
‘pily refer o sch ast of elements. By applying 22D trangultion onde image ei 
‘al mode, texted 3D wiangle mesh canbe produed. The 3D comedies of range 











Nences ae obained bom the unde geemutre maps wile ttre asin fae 
{su mapped ono the mesh sce pure), Intoul be noted Hat he geome maps eat 
‘ne ae expect to conan an approxi ofthe cee ra seomelc model 


Disparity estimation 
Depart estinutios proceeds so stapes (sce Fgue 8), Dring the Gist sige, we reas the 
robles of sero matching a daerte belie problers whe gins Uo bese ue 
the erergy optimization a loader Markov Random Feld. The node of he comenonding MRE 
‘ne going tbe pace fhe ef image ad the single nove pte for asining par dy 
{opie izing to be etna ws 





alr) -hotoif 


vita) = mil}, ~f) 


Here denots the manor allowed pens that ca be pose. or te opinion ofthe 
stove MRE the LP hse alpoins have bees we, ave the ca al para slut 
‘hich eae wo the optinal one. The sole the Et ge isto price a good ial eine 
the sprit td ave nyt cl ei sing Ue opinion procs, cpa is 
‘linemen of th spr Hel taking place. To tise the energy of 3 Fst oder Mskoy 
Sandon Feliu being nized ‘he teene, however, wih eet wo te Fst sage, 
‘stat now ole enna otiization scere being wie a0 tat pais Wh sa 
psc accra cam be obi Tapa, we we 4 Mand paket dese ype loenn 


Thaati-dyid-helesl +aZ Sat 





1) whore Ny he pot eigen of pt 


and dy agus epee the knows sinpariy Hell. The 2. parameter reputation 
prance, whe the potential function gf.) chosen to he dscmtinuty apie (2] (eg 3 
4s Gialy conte, The dry fick i nalized wih he values este ding the fast 
sia. Die wth nara the alent dee lgrten wally eeverges ery ft and 
oer ot get tapped oan poe eal inn 











Rolative pose estimation between successive local models 
tat MZ) gy Bo =O a Zei 





ceive lel del hoy the pth Fore eltve poe nin, we ne to eet & 
ser of pit matches (P10) tergeen de let images Tes of mets Hs especies 
“Aso ht such set of matches ead ets, the pose einai an occ at aos: 
se 3D points of comesponding wo Pare =F MZ Mand 9 there 





(RE AT) CP, where (a3 X5 orthoses Ta 3D vet sere 





So te pose ein canbe aco by mini 





Veins 





‘where st denstes Euchdcan image stance For this purpose, an terive contain 
‘miimiation alt may be applied with flan represented iterly by 3 qustenin 


val 


“The ese matrix (abo computable by the help ofthe matches (and 
re alg 








Wide-baseline feature matching under camera looming 
‘Tereloe the pose imation publ i redued to that of eting 4 sparse Jet 
cerepondenes betwee Jt,» A ttl method fr tackling the later problem is the 
following Gest et of terest pins im fy are erated (asing 2 ineet pit deter 
“Tet ow ech teres pol, sy set of aise pints CAND ini a age sctanular 
repiou SEARCH) of J, ae ctamined andthe best ne elected scoring Wo ialarty 
steer. Usaly the candid pints ae eticted ty applying a nee pit detector 0 


Howewe une kivight images of a serwosopie ews Uyote. 6 separa by wide 
‘oseine, Siple measures ke covrelion hive been proved exes melfwet shee 
Asm south jeeeliped pu and terere a sth hinge eta elec 
Techy) i fe aime ot the ala dierence at an chet apearnce in images 
Tete comes om the fortan camera moto along the Zui homing) The les for 


trctig val camepondenss then bse onthe flowing cbvervation: the donna elert 














fam obit bing closer to te camera in image J, ha sige repo ia, appeane 
sealed ly 0 cain vele howe ol. That i if pel_aret,,re coreponding 
1, ugh 1p) So-a image pach of 1, at p sul! bok xr to an nage pat of 





2a appropriately escle (by $") yesion of. OF course, he ale to ari se the 
‘age Thal he allaing ster, for extracting reliable mathe, canbe appli: 


1, Quast scale gc of 10a dete seco ales bees 





wojection of oa an by BOP a equate peo ap. 


2. Given ny it eas et of cara pints ANP r= lig yu oteaton 
1 ad sng the patches a any adsense any sale “the one must smart fat 


fe jean olin Tanti) 


‘This way, apa om 2 aching point? Uo, eae estimate # i pve or pit a8 
well 


“The shove amtegy ta been rove vy efetne giving high praage of ect tse 
even in ene vith very lange looming. Such an example etn be sen in igne 6 wherein the 
sages baseline Ss =1S mute resting seal ctor of e225 fr ena image 


seins Even f we sel a eae pots CANDp ofa pot ll pois inside SEARCHp 





Morphing estimation between suecessive local models 
AL the current tage ofthe modeling pipeline a sees of spoxinate Jel 3D mel abe 
‘vay apeinate estimates 

we La MZididm) Ls XntorZratdm) ge such a ple of 





scene lal els und 44a PO he erenponting ny potions on the pth By 
snaking use ofthe aproinate pose extimatebarween ant, we wil atame heer that 
the 3D yrioes af bath dls re exes in a cto 3D chun sper, Rather ton 
ling cree coment global model hy combina ll hel oes (rater tists 


ering among obes high gut geometry and pose estiation) we will tend follow a 











tere apna, which sas onthe alin eration ear pt pit pel 
‘seal or eprsering the serounig scene- On the ber ha se me ae tog the 
fof te eoveoameat are mach heer cared by tht ae (For example compare the Be 
kab ofthe chs tat ze tevesed on Figure 6 and are aot vile i Figure 7) So ding 
teas fom Pu POF wi yo gadly ene mel into new destin 
node, which boolean with + upon eaching pit pk (ln at, oly pat this 


esination del can coacide with 4 since in general 4. wil no represent eae the 
‘same prt ofthe scene) This morphing soul! be geomet as well a plone: (Ue ater 
‘wherever possible) nd tou proce ina pysclly valid way. For his season, we wil use 
‘sha we alla “mh abl 3d 


Lag =Ly UMP Zain) 


ely the deamon 30 Vests sl deuiaton coo ales fr al pos of 


Ina to incline ees of tain consi of ap %ae 





avanti daring he remering proven. the 3D coordinates "and colar Vf the 


vere of St pit i wilthn be 


[imc emt 
ert =) mii g)-+mt 3) | oD) 








{=O rmbatid ° 


where m spate detente amine of ching (Mat Pao at POM ad 
ent a teeween) . Speijing tsefore St snout 10 flog ia the vehes af the 
sesiation maps HF-2ac foreach point ?°4 Fortis purpose a 2sep procedure 


‘willbe followed tht depends on whether post phas.a physically comesponding point in or 














ete te tar saber of een MMA coming only a ose 4 pits tha hve 
sliricly coiling pits in del [ae eH! be fieton which ap hee 


int oth counterparts inthe 1 inage 


(opon  represet at pa ofthe see which is common to bath models 149. Since 


snot 4 ater erp shoud conde with ©, mut the bo 


[fe at 
| Flea pay) 
FF actuate 





Lac aut) 
te | Labia 


ois of igion ane threat wana bth pt etal an ect 


2 The st of he ott (that potas ia YA doe tae coumarin mn o 


Se tee pints wil ean Une elo yale (ms adel) a the deinion tap ad 
Hhsomce mori take pas 

LA hionwoee “a 

Hut we sill eed to apply geome morphing to thse pos 50 tat bo Dhttin / 
ticity ithe 3D structure ar obered daring tation fom P% yo PM Thertore 
“we sll need 10 Gi in the destination 30) cvonsinates for all points in 7. The 2 important 


‘etaing leach ali conte ce the ping pred) a 


+ How wo compte the mapping "Thee euialent wo etimating 32D otal ow Geld 


* And bow tin he vale fhe dentin geomet mp tthe pits 


inside region needed fr the geometric morphing therein Both ofthese tues willbe the 
set fhe ects tat fa, 








Estimating optical low between wide baseline images + and 

In general obs ave lately dense opal fw Geld between wide taelin ages 

fe! and “os is paieulaey dieu problem Without ablsonl put, usualy oly 

ars st osc flow vector eb bine inthe st cave. hice the has ble: 

1, Forctery pois in 4S tng pom of age 1s has to be suche for okie 
comesponding poi This wath chance of a8 erpeous opal bw sector merase 
Single ratees ie cirebtee) are very ielfclet Gr comparing pits Mocks 
teen wid base mages 

4. Svenif bth ofthe ahve problems are sed, ical ow eimai i inert an 
posed poem al ako asuiptons re ced In pati, we need 9 somehow 
‘pose he condition at the opal ow eld willbe prceiae sem 


For dealing wih the at obi, we will uke ue of the undeying momen 


NetiZ ot moet 4 as well the relive pose haween 46 and fy sig these 


quate, we can ore rot any pi sy of "ox image tn patie 
Sle ll ofthe shove quis re esti oly proxies ths perms js wo reset 
tte seching over asl eon Ry aru the eoecton pin. The search ein cat be 
sted fete by king th aterm of Ry wa al one ab the epipole e 
comeing. atn, ce we ate interested sacking oy for pins of + ta 
teang wo Ms hic where 4 i defined) the inl sec enon SEARCH fp wile 
dis ¢ SEARCHp is xy; tes os! vet Wil eens nd pot p 
rl conrad ot longing oregon ordeal Ww these robles, we wl 
the a tnlge sia to gta spe st of crepes. As aay ted hei. the 
oi eft dew 4 oming of he eaters shat pie eights ing ae 
‘sees by tor ayog ars the ge. The wot proposed en was compar nage 
ances! sc only witches hos! tal wk peas hen acl vena a 
(he ter inage, We wll we he une echigu eit be only difeene trng ht tend 
of oing tt fr a spane soup eater we wil bw apply to a dene et of pelo nage 

Sa Hnaen-eoncen) 





4 or tis purpose we will agus ae a discrete set of le ft 





an we will seals itage “6 by each owe thee facto wher, at ber, ie 
rescal by (wah ©) i be densely I. AS We al se the eat pre ths 














vl have the elt of ving ange the yp of bls da we wil se ste asec 
Iaketing yobs. 


ff fist order Markov Random Fa 9]. Wha is wont sing Bore i al cna to 
Standard opie ow tintin procedure, the sbelb wall ow comist of yecrs 
eon 








‘whet fst 2 somites dense te sommes fhe op Hy 

vector wii the thd one dente the sae fctr This mee tt ae bing, wo nly a 

pia ow, fa ao sale etimaion wll be rove foreach poi (ce Figure 9), Given 8 

luke L we wil dena opal tw vector by POMOC.) gp sea by AH )=* 

‘Based on wat wa Sealy retool bove che labels which are allowed wo bean wa 2 
{ABEL = 4:46 SEARCH, 8 





ont pis Sil be coming othe wing se 
“This deftion of te tat set SEARCH simpy encodes the flowing two hing: 


sre region SEARCH 


1 We a search across all seas in SL. gen 2 caste matching point 1° SEARCH jg 
Tri.) 








we compare puch ih any of the pes char the scale 5 


leavers all the elements of et S (sce Figure 8) As belore TTPT®“Ndentes 3 Ge sine 


atch sound p, white ToD ts gees an equal sie patch, whic seat sound the 


rojction of om the rescaled nae 


Gening a8 opal ow Heb & hen equvaeat 19 picking one element frm the Caesi 


procs MRT APES, or ea cle of LABELS, which eins 


Tvl DMs) AS) 


fe 





“The st am in FU repens the grt et nd pais opal Now Geis wich ee ot 
ecevise soc, ile te acood tin inthe above ene rereets the Ukeiod and 
symbol denotes set tring pans of ptls nike we pialy assume asym 














sighted) ant Viel eactes the pr wie pti funtion ate MIE nou ie this 
‘hection ca hee lle 


annette an a) “ 


where * dente the maim pair wise pealy tit ean be impos. Singer pie wie 
tenia ution tik he Pots funcio,haye ena tested. Reding te tes Ye? 
‘tose messi the comeltion beeen comespoaling image paces as dterined by the 


lube Accoing toa beling “ora pint ? in a comesponding point the 
fw) 


rejection ty image 08! ot pei 2 Thc can that we shuld compare the 


hes yg TTR ROT al sean We et 


V4 )= eT Taal RETRO TO 


‘The shove energy Fa) cam be minimized using any of the LP-bsed MIRE opinion 
alpen . The outing opal ow, olsied when wing the wo inages of Figure 6 a 
pial ow seu, which ine I search cae sakes tates pace te, S=1N Ay 
ipeted, i ths case, the sesuing optieal ow i very mony for repos ha are actully 
ndeguing age change of el 


Geometric morphing in region” 





‘Alter estimation of pte flow "we ay apply eguation (31a plas in * and ts 


fat te arags Nie¥arir tem ue Figo 10). Teer. a this stage of the modeling 
pine the vale of the deiaion geri mp Xara Zar are kt for al pints 





‘inside region uta unknown fora pois side epion ® =A he the 
rebion which ihe complement ut % ia 5 Hereaer, he akeadykaown les ofthe 
entiation geome wage wile dete by Sari 2an bo, wed 





Keel te Til Bae Zul 9) 

















To completely speify merging, we sl ned Hite vals of the desinaion geomet 





I oer words, we need 10 specly the destination 30 
rertces fo allpoiatsot 4 in Since these points do not have a physically coeresponding 


ict in 41, we cant apply (3) 40 get 4 deintion 3D verte ean det, The 
Smplest soluion woul he that my zeometi morphine applied Ls hese pots st tha hee 


entiation yrs just eieckle with hie 1 vice, Howes, atte: 


* pineia ¥ wil ave destin erties ome 





“The problem euhing ot ti usin Ut the reduced deiation map Zn 
(oce Figs 10,11) will eon discon aly the Boundary (ay °F ) heween gions % 
ant 7 casing his vny anoying dicot anit (le) inthe geometry of te 
“rable AD-nndel dur the maphing poceduse Tis wll apnea bec he peomety 
cof toth & and oa ella iesetive poe ave hen xine oly approximately and 


‘herelne thine lo des sy ol match perfectly whe paced a comma SD courte 


"The ght way il the dentition verte the pos in 7 is hse om the bean 
tha pally vali deviation 3D del ab satay the lowing 3 condos! 


1. On the houndary of ¥ 0 discoesswity sv 3D structure sould exist i. the unknown values 


ot Mali song the boundary °F stoull match the ecteponting kaown waies 


species ty Tali Zan so 





2. tte interior of the relative 3D stratus of the initial 4 model souk be preserved, 


Inuatey, these wo coins spy imply hat a ul af raping. vertices of aide 


20 vertices of 4! along the bouiry of 7 tn athena ter the fet cation 
yay rats 











Nabe kasbetle™ Fiabe Zi be=Ziahe 
) 
‘wile the Seon onion, which poses the estan of preserving the eave 3D sacar 
ot py 
XX] PK UPI-NV 
ee i] [isc 








Riel 


(one foreach of Yar Yin Zin) which i all of the ane tp I there sie consider 


ly one of these Eig. fo etinating Zor we need 40 fad he sttion 40 the following 
pinto robe 


Sipe sah x 0r-2uett2) 


‘or dscrting the above poblem we can make we ofthe undead pie oi To his 
fend, we ante a eye eighrtod forthe image pitle and we dense by Nip) the 
Creponding mighorbood of psel p Un the ease, the bounty Or qu the set 
2 = {ne Np + Olid the Hie diese discretization of (5) yet follwing 

















Llp. wpe 0) 


han canbe aed wth an erative gorithm very ecetly due othe ft ta al ese ear 
syuntlons orm pase (banded stern 


Abo, an atematve nay of solbing our optinizaton problem ia (5) i by observing al any 
Auction minimising (5) ako soliin tthe allowing Fekace equation with Dict 
‘oun oman [11 





di WZ,) Wi p= lS) 


‘Therefore in his eave, in onder ete the peometee maps XP sles tha We 


sslve 4 independent Ponce elation ofthe abive type Soe Figures 10, 11 Sr reat 
roducel alts tind 


Conclusion 
‘We have poses my appoach fr otsning potest a intracive Wallaroo 
Jae ator seme To hs ns ne yb dts ttre as bee resented, wich eae 
“norphable3D-mossi No pal made of ie sone ads be comarca aan ie 
lrg theremin process, only on orpable Dern” displayed. Ths enlaces the 
Sealy the tea to ge envzommeats In aldsion the propose mba wes 
‘een path, which is Rghly opined in modern 3D rps tara al hes an produce 
‘ender ieline so htt canal ake int cont dh fm pre steno viet hak 
Ive hee eure at cats oughout the cee anos alone predefined pth Tis 
cll fuer enlace the quality of three cee ni woul ope amore etenive 
‘apatite vial eevivemet. Morera etenion sl fas precy ta the cent 
asshiecture ofthe D-aceleratareering pple (a ening of mpl les mons will 
Sl te aking place 
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eB The madeng pain 











‘igure 2: For calibrating ur camera we capture images of aches patter atrandom postions 


‘gure: Depth map 20 fa local model sek peels do not belong tts aid elon deme 





Figure: rendered view of the eal model wing an underlying Wane mesh 
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opimization 
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‘igure: The Zstages needet fr dary estimation 
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et 
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gure 7: Optica ow vectors on images (2) 








Resting els wit the neighborhood ofp 


Figured Sele facors and opel Now magnitudes of mages, 


bd Sib 


gure 1: Destination depth 









ewe 11: Rendered evs of apa 3P-motl dura tation Pom hy pson 
‘coresponding tolmage 














‘gure 12: Pel shader code (and the astciated vertex shader ode), writen GIS (Open 
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